and use excessive system resources. For this reason, and because of the rapid 
rate at which new applications can be developed, it is particularly important 
in a PCS environment to do an effective job of predicting and tracking system 
resource usage. 


There are three more "technical" problems that currently affect the use of 
PCS/ADS. First, all PCS transactions run under a single CICS transaction name. 
To CICS, PCS is a single transaction. This prevents assigning differing prior- 
ities to different PCS-based applications. Second, the PCS execution modules 
are written in CICS macro-level Assembler language. Some new CICS facilities 
can only be used with command level transactions. Finally, the PCS DCL pro- 
cessor runs as a conversational transaction, causing data areas for DCL-based 
transactions to tie up virtual storage for long periods of time. We have not 
considered any of these problems to be prohibitive to our use of PCS. Indeed, 
some of them are by-products of its overriding advantages. In addition, we are 
optimistic that the technical problems cited above will be resolved. 


Summary 


PCS/ADS is a general purpose, CICS-based application generator that has been in 
use at The University of Iowa Hospitals since 1978. It's primary advantages 
are: 


1. The development cycle is speeded up due to the minimal requirements 
for conventional programming. 


2. PCS/ADS facilitates system prototyping and an iterative development 
process. . 


3. The reduction of conventional programming requirements allows the 
: systems developer to concentrate on understanding user requirements 
and on system analysis and design. 


4. The systems developer has the flexibility to use screen descriptions, 
Data Collection Lists, or conventional programs to implement PCS/ADS 
transactions. 


5. Users are kept involved by the iterative development process and 
may also create or modify screen and print formats. 


6. PCS/ADS includes a good, high-level test facility. 
We have found these advantages to far outweigh its disadvantages. In conjunc- 


tion with the other application-development tools and the development method- 
ologies in use here, PCS/ADS has proven to be an effective and valuable tool. 
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ABSTRACT . 


Consistently defined and applied application development and maintenance — 
measurements are essential to a program to improve the application development 
and maintenance activity in an organization. Those measures are required: 


- To identify and promote practices. which help. 
- To identify and avoid practices which hurt. 

- To support rational estimating processes. 

- To portray productivity improvement trends. 


PWN 


These basic objectives of productivity measurement will .be used to define a 
measure called Function Points. Experience with this measure will be described. 
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ABSTRACT 


Introduction 


The overall objectives of AD/M productivity measurement are stated. The funda- 
mental concepts of work-product (output), work-effort (input), and attributes 
(factors affecting productivity) are defined. The relationships among measure- 
ment, quality, management, flexibility, non-technical user, and estimating are 
described. 


Definitions 


A work-product measure called Function Points is defined. The components of the 
Function Points measure, namely: input, output, file, interface file, and in- 
quiry types; the adjustment for processing complexity; and the Function Points 
calculation are defined. The work-hours and work-months measure of work-effort 
are defined, and a way of describing the attributes is established. 


Current Practices 


The current recommended practices, for determining the measures defined above, 
are described. This section is expected to be kept current by periodic update 
as practices change. 


Worksheets 


Work-sheets to guide a measurement process, based on the definitions and current 
practices described above, are provided. 
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1.0 INTRODUCTION 


This guideline covers the measurement, of the productivity results and trends, 


of the application development and maintenance (AD/M) activities at an AD/M 
site. . 


The purpose, of the guideline, is to provide, each AD/M site, a consistent way 


to measure, portray, and demonstrate the productivity of their AD/M activities. 
It is also intended, to help distinguish good AD/M actions and characteristics 
from bad, and to help improve the estimating process. It should, consistently 
and fairly, promote helpful exchange and use of data among activities at a site, 
and among sites, divisions, country organizations, and groups. 


1.1 OBJECTIVES 


A successful AD/M activity, or project, in terms of AD/M responsibilities, is 
one that satisfies the agreed-to user's requirements, on schedule, and within 
budget. However, the record of successful activities, or projects, alone, can be 
misleading, since it is based on estimates and agreements. Without a trend of 
their measured productivity, or a profile of measured productivity from other 
sites, it is difficult for a site to determine that the estimates are compet- 
itive. (That is, among the most effective alternatives). Site management may not 
know how much more efficiently the activity, or project, might have been done. 


An effective AD/M productivity measure should accomplish several objectives: 


1. Consistently determine the productivity of an  AD/M development, 
enhancement, implementation, or period support activity, or project, rela- 
tive to other similar activities at the site, and other AD/M sites. 


2. Promote actions or decisions that can improve the output of the AD/M site. 


3. Demonstrate the results of the actions taken to improve the output of the 
AD/M site. 


4. Support the estimating process at the AD/M site. 


5. Support the management process at the AD/M site. 


1.2 CONSIDERATIONS 


Two basic measures must be established for any productivity measure -- one meas- 
ure must define work-product output, and the other must define work-effort in- 
put, or cost. Work-product divided by work-effort is called "productivity". Its 
trend should be up. Work-effort divided by work-product is called “unit cost". 
Its trend should be down. Either measure can be used, depending on the emphasis 
wanted. (More product or less cost)? In this guideline, both will be considered 
to be productivity measures. 


The productivity measure or unit cost measure places an AD/M activity, project, 


or site on a relative scale. The attributes of the application, activity, 
project, or site determine the reasons for that relative placement. Attributes 
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are factors that are expected to influence productivity, such as: application 
size; user maturity; development environment; team maturity; percent new, modi- 
fied, or reused as-is; management processes; development processes; tools; and 
techniques. Since they are the things one must understand, and change, to move 
the productivity or cost trends in the right direction, attributes must be meas- 
ured and recorded as diligently as the work-product and work-effort measures. 


1.2.1 Non-Technical User 


It is desirable that the work-product measure be meaningful to the non-technical 
user. The user can then review, and agree with, the work-product measure applied 
to an activity or project. This can help ensure that a high quality activity or 
project is being measured. (That is, one that meets the user's requirements). Le 
can also help the user understand the estimates on future activities or 
projects, and promote more informed discussions about changes. 


1.2.2 Flexibility 


To provide a number of options for improving productivity, the work-product mea- 
sure should allow choices among technologies. The measure should accommodate 
new approaches, such as: higher level languages, code generators, and shared 
applications. If the objective of the AD/M site is to deliver data processing 
function to the user, then the work-product measure should be based on the ap- 
plication function from the user's view. 


1.2.3 Quality 


The activities and tasks in AD/M are interdependent. The quality and complete- 
ness of early design tasks, can affect the productivity of later development 
tasks. More significantly, an incomplete or low quality development project, can 
make the support activity very unproductive. The management and review 
processes, for each activity, task, phase, or project, must ensure that each 
work-product meets the quality required of the activity. No provision should be 
made, to measure and include the work-product measure, associated with an una- 
ceptable work-product. Low quality work-products, identified by the management 
and review processes, or by productivity measurement on the subsequent activ- 
ities, should be assessed and the weaknesses found should be used to improve the 
AD/M process. 


1.2.4 Estimating 


Three activities must be accomplished to estimate an AD/M activity or project 
effectively: 


1. The tasks must be identified, listed, and sized. 


to 


Based on the tasks, an estimate must be developed. 
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3. The estimate must be validated, using other methods. 


These estimating activities should be accomplished in the early phases of the 
activity or project. If the work-product measure is to be helpful in validating 
estimates, it should be formed of elements that can be determined reliably in the 
early phases, of a project. 


1.3 CONCEPT 


1.3.1 Work-Product 


The measure called Function Points, based on user application function, has been 
chosen as the primary measure of AD/M work-product in IBM. Function Points meas- 
ures an application by quantifying the standard processing associated with ma- 
jor external data or.control input, output, or file types. This standard 
processing is then adjusted for processing complexity by applying general ap- 
plication characteristics, such as: communications, performance, transaction 
rate, and ease of installation. The result is Function Points.! An overview of 
Function Points is shown in Figure 1 on page 4. 


Function Points are evaluated for an application by listing, classifying, and 
counting the following major data or control types, to three levels of complex- 
BB om! a 


Data or Control Types: Complexity Level: 


o External Input 

o External Output - o Simple 
o Logical Internal File o Average 
o External Interface File o Complex 
o External Inquiry 


Each of the 15 possible counting classifications are then weighted by a factor 
to measure the relative amount of standard processing associated with each data 
or control type. The resulting sum is then adjusted for processing complexity 
by applying a factor based on the following: 


General Application Characteristics: 


1. Data communication 8. On-line update 

2. Distributed function 9. Complex processing 
3. Performance 10. Reuseability 

4. Heavily used configuration 11. Installation ease 
5. Transaction rate 12. Operational ease 
6. On-line data entry 13. Multiple sites 

7. End user efficiency 14. Facilitate change 


; A complete definition of Function Points is given in Section 2.0. The cur- 


rent counting practices for Function Points are shown in Section 3.0. 
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Figure 1. Function Points Overview. 





The Function Points measure has been chosen for the following reasons: © 


Ls 


The measure is based on the users external view of the application. This 
will allow choice in the technology used internally, without changing the 
measure. 


The counts, classifications, and general characteristics can all be deter- 
mined early in the development cycle, as soon as the external design has 
been completed. This will enable Function Points to be used in the estimat- 
ing process. 


Function Points can be understood and evaluated by a non-technical user who 
knows the application. This will enable the informed user to review and 
agree with the AD/M work-product measure. 


Function Points have shown to be an effective measure of AD/M work-product. 


Function Points have been used by 17 IBM AD/M Sites to measure the 
work-product of 191 application development projects. The measurements have 
encompassed 137,000 function points of work-product, and 830 work-years of 
application development work-effort. From another viewpoint the 
work-product included 9,000,000 source lines of code. The resulting produc- 
tivity trend lines and profiles appear to be useful. 
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1.3.2 Work-Effort 


To complete a productivity measurement, measures of work-effort are needed. The 
measures must record the amount of work-effort, and the tasks, activities, and 
phases included. 


Two definitions should be understood: 


1. The net work-hour, work-month, or work-year, which assumes that all recorded 
time is spent working. None of the recorded time is used for holiday, vaca- 
tion, general education, or other personal absence. 


2. The gross work-hour, work-month, or work-year, which assumes that the re- 
corded time accounts for the time spent working, and the personal absence, 
as described above. 


The work content of a gross work-hour, work-month, or work-year is generally 
about 75% of the work content of a net work-hour, work-month, or work-year in 
most organizations. 


Conceptually, these measures are straightforward and have been used for many 
years, but differences in work practices at the various AD/M sites can cause the 
measures to differ. The definitions should be determined and stated by each or- 
ganization with their productivity measures. 


All the work-effort used to accomplish the tasks, activities, and phases of the 


pertinent AD/M process should be included, without regard for organization 


'lines. For example, if | a user works on design tasks for an application develop- 


ment project, the user's time should be included in the work-effort for the pro- 
ject. The work-effort measures should include the work-hours, work-months, or 
work-years that were used to accomplish the following phases of the AD/M 
process: : 


¢ Design - Study, Requirements, External Destems Internal Design, and Devel- 
opment Planning. 


. Development - Design, Code, Unit Test, Integration, System Test, Documenta- 
tion, Installation Planning, and Support Planning. 


° Installation - Education, Data Conversion, and Installation. 


° Support? - Installed Application Support, Fixing, and Retrospective Analy- 
sis. e, 


1.3.3 Attributes 


When selecting the Attributes of an AD/M activity, project, or site, to be meas- 
ured and recorded, one-must balance the desire to record. only a few factors, 


The work-effort measures and activities, phases, and tasks recommended to be 
measured and recorded are defined more completely in Sections 2.0, 3.0,and 
4.0. 

Functional changes or enhancements are expected to be reported as projects 
under the design, development, and installation phases. ; 
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against the need to avoid overlooking the factors really influencing productiv- 
ity. Generally the analysis proceeds as follows: 


1. A series of productivity measurements are made and recorded. These measure- 
ments are arranged in order of productivity to highlight deviations from 
normal. 


2. The known characteristics of the activity, project, or site are then system- 
atically explored to see which characteristics, or. atteiputes: seem to ex- 
plain the deviations from normal best. 


3. Those attributes that seem to be most important are then analyzed more com- 
pletely to determine their effect on productivity, and how completely they 
explain the deviations. 


4. These results are then used to: 


: Pursuade those responsible to change the attributes of sites, projects, 
and activities as indicated, thus causing productivity to increase. 


* Estimate and validate the resources planned for future activities and 
projects. 


° Identify the attributes to be measured and recorded systematically for 
all activities and projects. 


The concept of this guideline will be to measure and record the most important 
attributes thought to affect productivity significantly, with provision for 
identifying and recording new attributes as ny become more important. 


The. attributes recommended to be measured. and recorded for AD/M activities, 
sere and sites will be listed and described more completely in Section 
.O and Section 3.0. 
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2.0 FUNCTION POINTS DEFINITIONS 


This section provides the basic definitions supporting the measurement, record- 
ing, and analysis of Function Points, Work-effort, and Attributes. 


2.1 GENERAL 


The following considerations are generally applicable to the specific defi- 
nitions of Function Points, Work-effort, and Attributes in later paragraphs in 
this section. 


2.1.1 Development Work-Product vs Support Work-Product 


Development productivity should be measured by counting the Function Points ad- 
ded or changed by the development or enhancement project. Therefore, 


Development Work-Product = The absolute value sum of all Function Points added 
or changed by the development or enhancement project. (Deleted Function Points 
are considered to be changed Function Points). 


Support productivity should be measured by counting the total Function Points 
supported by the support project during the support period. Therefore, 


Support Work-Product = The original Function Points of the application, ad- 
justed for any changes in complexity introduced, plus any Function Points added, 
minus any Function Points deleted by subsequent enhancement projects. 


2.1.2 Measurement Timing 


To provide the work-product, work-effort, and attributes measures needed for 
each development project, enhancement project, and support project to be ana- 
lyzed, the indicated measures should be determined at the following times in the 
application life cycle: 


e The estimated development work-product, estimated work-effort, and planned 
attributes measures should be determined at the completion of the External 
Design Phase for each development and enhancement project. (When the com- 
plete user external view of the application has been documented). 


e The development work-product, actual work-effort, and attributes measures 
should be determined at the completion of the Installation Phase for each de- 
velopment and enhancement project. (When the application is ready for use). 


: The support work-product, actual support work-effort, and attributes meas- 


ures should be determined at the end of each calendar year of support and 
use for each support project. 
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2.1.3. Application Boundaries 


Normally, as shown in Figure 1 on page 4, a single continuous external boundary 
is considered when counting Function Points. However, there are two general si- 
tuations where counting Function Points for an application in parts, is neces- 
sary: 


1. The application is planned to be developed in multiple stages, using more 
than one development project. 


This situation should be counted, estimated, and measured as separate pro- 
jects, including all inputs, outputs, interfaces, and inquiries crossing all 
boundaries, because it is intended to be managed as multiple projects. 


2. The application is planned to be developed as a single application using one 
development project, but it is so large that it will be necessary to divide 
it into sub-applications for counting Function Points. 


The internal boundaries are arbitrary and are for counting purposes only. 
The sub-applications should be counted separately, but none of the inputs, 
outputs, interfaces, and inquiries, crossing the arbitrary internal bounda- 
ries to the other sub-applications, should be counted. The Function Points 
of the sub-applications should then be summed to give the total Function 
Points of the application for estimation and measurement, because it is in- 
tended to be managed as a single project. 


2.1.4 Brought-In Application Code 


Count the Function Points provided by brought-in application code (reused code), 
such as: an IBM IUP, PP, or FDP; an internal shared application; or a purchased 
application if that code was selected, modified, integrated, tested, or in- 
stalled by the project team. However, do not count the Function Points provided 
by the brought-in code that provided user function beyond that stated in the ap- 
proved requirements. 


Some examples are: 


1. Do count the Function Points provided by an application obtained from anoth- 
er IBM site, or project, and installed by the project team. 


2. Do not count the Function Points provided by software, such as IMS or a 
screen compiler, if that software had been made available by another project 
tean. 


3. Do not count ADF updates of all files if the user only required updates of 
three files, even though the capability may be automatically provided. 


2.1.5 Consider All Users 
Consider all users of the application, since each application may have provision 
for many specified user functions, such as: 


- End user functions. (enter data, inquire, etc.). 
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Conversion and installation user functions. (file scan, file compare dis- 
‘crepancy list, etc.). 


Operations user functions. (recovery, control totals, etc.). 


If the user functions are specified to be provided, they are functions that 
should be included in measuring the development work-product. If the user func- 
tions are specified to be maintained, they should be included in measuring the 
support work- product. It is possible that some conversion and installation us- 
er functions may not be specified to be maintained and should not be included in 
the support work-product. 
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2.2 FUNCTION POINTS MEASURE 


After the general considerations described in the preceding paragraphs have been 
decided, the Function Points measure is accomplished in three general steps: 


1. Classify and count the five user function types 
2. Adjust for processing complexity 
3. Make the Function Points calculation 


The paragraphs in this section define and describe each of these steps. The 
first step is accomplished as follows: 


Classify, to three levels of complexity, the following user functions that were 
made available to the user through the design, development, testing, or support 
efforts of the development, enhancement, or support project team: 


1. External input types 

2. External output types 

3. Logical internal état y ces 
4. External interface file types 
5. External inquiry types 


Then list and count these user functions. The counts should be recorded for use 
in the Function Points calculation, on an appropriate work-sheet. Examples of 
useful Function Points work-sheets are provided in Section 4.0, Function Points 
Work-sheets. 


The definitions of each of the user functions to be counted, and the levels of 
complexity, are provided in the following paragraphs. 


2.2.1 External Input Type 


Count each unique user data or user control input type that enters the external 
boundary of the application being measured, and adds or changes data in a log- 
ical internal file type. An external input type should be considered unique if 
it has a different format, or if the external design requires a processing logic 
different from other external input types of the same format. As illustrated in 
Figure 1 on page 4, include external input types that enter directly as trans- 
actions from the user, and those that enter as transactions from other applica- 
tions, such as, input files of transactions. 


Each external input type should be classified within three levels of complexity, 
as follows: 


° Simple - Few data element types are included in the external input type, and 
few logical internal file types are referenced by the external input type. 
User human factors considerations are not significant in the design of the 
external input type. 


Average - The external input type is not clearly either simple or complex. 
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. Complex - Many data element types are included in the external input type, 
‘and many logical internal file types are referenced by the external input 
type. User human factors considerations significantly affect the design of 
the external input type.° 


Do not include external input types that are introduced into the application on- 
ly because of the technology used. 


Do not include input files of records as external input types, because. these are 
counted as external interface file types. 


Do not include the input part of the external inquiry types as external input 
types, because these are counted as external inquiry types. 


2.2.2 External Output Type 


Count each unique user data or control output type that leaves the external boun- 


dary of the application being measured. An external output type should be con- 


sidered unique if it has a different format, or if the external design requires 
a processing logic different from other external output types of the same 
format. As illustrated in Figure 1 on page 4, include external output types that 
leave directly as reports and messages to the user, and those that leave as re- 


ports and messages to other applications, such as, output files of reports and | 


messages. 
Each external output type should be classified within three levels of 
complexity, using definitions similar to those for the external input types. 
(paragraph 2.2.1). For reports, the following additional complexity definitions 
should be used: 

° Simple - One or two columns. Simple data element transformations. 


. Average - Multiple columns with sub-totals. Multiple data element transf- 
ormations. 


° Complex - Intricate data element transformations. Multiple and complex file 
references to be correlated. Significant performance considerations. °® 


Do not include external output types that are introduced into the application 
only because of the technology used. 


Do not include output files of records as external output types, because these 
are counted as external interface file types. 


Do not include the output response of external inquiry types as external output 
types, because these are counted as external inquiry types. 


More specific practices for determining complexity are defined in the Cur- 
rent Practices Section 2.3. 
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2.23 Logical Internal File Type 


Count each major logical group of user data or control information in the appli- 
cation as a logical internal file type. Include each logical file , or within a 
data base, each logical group of data from the viewpoint of the user, that is 
generated, used, and maintained by the application. Count logical files as de- 
scribed in the external design, not physical files. 


The logical internal file types should be classified within three levels of com- 
plexity as follows: : 


° Simple - Few record types. Few data element types. No significant perform- 
ance or recovery considerations. . * 


. Average - The logical internal file type is not clearly either simple or 
complex. : , 


3 Complex - Many record types. Many data element types. Performance and re- 


- covery are significant considerations. ®* 4 


Do not include logical internal files that are not accessible to the user 
through external input, output, interface file, or inquiry types. 


2.2.4 External Interface File Type 


Files passed or shared between applications should be counted as external in- 
terface file types within each application. Count each major logical group of 
user data or control information that enters or leaves the application, as an ex- 


‘ternal interface file type. External interface file types should be classified 
‘ within three levels of.complexity, using definitions similar to those for log- 


ical internal file types. (paragraph 2.2.3). 


File types that are used by the application and are also shared with other ap- 
plications should be counted as both Logical Internal File Types and External 


‘Interface File Types. 


2.2.5 External Inquiry Type 


Count each unique input/output combination, where an input causes and generates 
an immediate output, as an external inquiry type. An external inquiry type 
should be considered unique if it has a format different from other external in- 
quiry types in either its input or output parts, or if the external design re- 
quires a processing logic different from other external inquiry types of the 
same format. As illustrated in Figure 1 on page 4, include external inquiry 
types that enter directly from the user, and those that enter from other appli- 
cations. 


The external inquiry types should be classified within three levels of comp lexi- 
ty as follows: 


1. Classify the input part of the external inquiry type using definitions simi- 
lar to the external input type. (paragraph 2.2.1). 
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2. Classify the output part of the external inquiry type using definitions sim- 
ilar to the external output type. (paragraph 2.2.2). 


3. The complexity of the external inquiry type is the greater of the two clas- 
sifications. 


To help distinguish external inquiry types from external input types, consider 
that the input data of an external inquiry type is entered only to direct the 
search, and no update of logical internal file types should occur. 


Do not confuse a query facility as an external inquiry type. An external inquiry 
type is a direct search for specific data, usually using only a single key. A 
query facility provides an organized structure of external input, output, and 
inquiry types to compose many possible inquiries using many keys and operations. 
These external input, output, and inquiry types should all be counted to measure 
a query facility. 


2.2.6 Processing Complexity 


The previous paragraphs define the external input, external output, internal 
file, external interface file, and external inquiry types to be listed, classi- 
fied, and counted. The Function Points Calculation (paragraph 2.2.7) describes 
how to use these counts to measure the standard processing associated with those 
user functions. This paragraph describes how to apply some general application 
characteristics to adjust the standard processing measure for processing com- 
plexity. 


The adjustment for processing complexity should be accomplished in three steps, 
as follows: 


1. The degree of infuence, on development and support, of each of the 14 gener- 
al characteristics, should be estimated from the user's view of the applica- 
tion. 


2. The 14 degree of influence(s) should be summed, and the total should be used 
to develop an adjustment factor ranging from 0.65 to 1.35. (This gives an 


~ 


adjustment of +/- 35%). 


3. The standard processing measure should be multiplied by the adjustment 
factor to develop the work-product measure called Function Points. 
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The first step is accomplished as follows: 


Estimate the degree of influence, on the application, of each of the 14 general 
characteristics that follow. Use the degree of influence measures in the follow- 
ing list, and record the estimates on a work-sheet similar to Figure 7 on page 
34 


Degree of Influence Measures: 


Not present, or no influence if present 
Insignificant influence 

Moderate influence 

Average influence 

Significant influence 

Strong influence, throughout 


o00000 


WUE WHE © 


General Application Characteristics 

1. The data and control information used in the application are sent or re- 
ceived over communication facilities. Terminals connected locally to the 
control unit are considered to use communication facilities. 


2. Distributed data or processing functions are a characteristic of the appli- 
cation. 


3. Application performance objectives, in either response or throughput, in- 
fluenced the design, development, installation, and support of the applica- 
Cion. 

4. A heavily used operational configuration is a characteristic of the applica- 
tion. The user wants to run the application on existing or committed equip- 
ment that will be heavily used. 


5. The transaction rate is high and it influenced the design, development, in- 
stallation, and support of the application. 


6. On-line data entry and control functions are provided in the application. 
7. The on-line functions provided, emphasize end user efficiency. 
8. The application provides on-line update for the logical internal files. 
9. Complex processing is a characteristic of the application. Examples are: 
: Many control interactions and decision points. 
° Extensive logical and mathematical equations. 


. Much exception processing resulting in incomplete transactions that 
must be processed again. 


10. The application, and the code in the application, has been specifically de- 
signed, developed, and supported for reuseability in other applications, and 
at other sites. 


11. Conversion and installation ease are characteristics of the application. A 


conversion and installation plan was provided, and it was tested during the 
system test phase. 
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12. Operational ease is a characteristic of the application. Effective start-up, 
back-up, and recovery procedures were provided, and they were tested during 
the system test phase. The application minimizes the need for manual activ- 
ities, such as, tape mounts, paper handling, and direct on-location manual 
intervention. 


13. The application has been specifically designed, developed, and supported to 
be installed at multiple sites for multiple organizations. 


14. The application has been specifically designed, developed, and supported to 
facilitate change. Examples are: 


° Flexible query capability is provided. 


° Business information subject to change is grouped in tables maintain- 
able by the user. 


2.2.7 Function Points Calculation 


The previous paragraphs describe how the function types are listed, classified, 
and counted; and how the processing complexity adjustment is determined. This 
paragraph describes how to make the calculations that develop the Function 
Points measures. 


Using the definitions in Paragraph 2.1.1, two equations have been developed to 
more specifically define the development work-product measure and the support 
work-product measure: 


u 


Development Work-Product FP Measure = (Add + ChgA)PCA2 + (Del)PCA1 = : 


Support Work-Product FP Measure = Orig FP + (Add + ChgA)PCA2 
- (Del + ChgB)PCA1 = 





Orig FP = adjusted FP of the application, evaluated as they were before 
the project started. 


Add = unadjusted FP added to the application, evaluated as they are 
expected to be at the completion of the project. 


ChgA = unadjusted FP changed in the application, evaluated as they 
are expected to be at the completion of the project. 


Del = unadjusted FP deleted from the application, evaluated as they 
were before the project started. 


ChgB = unadjusted FP changed in the application, evaluated as they 
were before the project started. 


PCA1 = the processing complexity adjustment pertaining to the app- 
lication before the project started. 


PCA2 = the processing complexity adjustment pertaining to the app- 
lication after the project completion. 
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The lists of the function types developed, using Figure 8 on page 35 and 
Figure 9 on page 36 as work-sheets, provide the information for calculating the 
unadjusted FP. A portion of the filled-in form might look like this: 


In., Out., Inq., Function List Complexity Record 


Ty ID |Ref Description 
DET | FTR Chg|DET|FTR 


ype 

IT fee! 001|Sign-on screen 

IT |PSCC/} 001|{Cost center transaction 

IT foe eee change transaction 


















Type = the general function type. 
ID, Ref, and Description = the specific function type. 


Before = the complexity record of the specific function type as it was 
before the project was started. 


After = the complexity record of the specific function type as it was 
expected to be after the project was completed. 


DET = number of data element types in the function type. 

FTR = number of file types referenced by the function type. 

Del = the complexity of the deleted function type. 

Chg = the complexity of the changed function type.(before and after). 

Add = the complexity of the added function type. 
If the application consists of only new or added function types, the develop- 
ment work-product FP measure equals the support work-product FP measure. The 
form shown in Figure 7 on page 34 can be used to calculate both measures as fol- 


lows: 


1. Using the lists discussed above, the general function types at each complex- 
ity level are counted and entered in the function count matrix. 


2. The weights shown on the form are applied and the results are summed to give 
the unadjusted function points. 


3. The processing complexity adjustment pertaining to the application at the 
completion of the project is developed using the general application charac- 
teristics described in Paragraph 2.2.6. 


4. The processing complexity adjustment is applied to the unadjusted function 
points to give the Function Points measure. 
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If the application is an enhancement project, consisting of added, deleted, 
and/or changed function types, the development work-product FP measure does not 
equal the support work-product FP measure. The appropriate forms are shown in 
Figure 10 on page 37 for the development work-product, and Figure 11 on page 38 
for the support work-product. They are used as follows: 


1. The general function types are counted and entered into the appropriate ad- 
ded, deleted, or changed matrices. 


2. The added, deleted, or changed unadjusted function points are determined on 
each form. 


3. The processing complexity adjustments pertaining to the beginning or the end 
of the project are applied to each form to give the Function Points 
measures. 

These measures of work-product can then be used with the measures of work-effort 

(section 2.3), and the attributes of applications and projects (section 2.4), to 

accomplish the following analyses: 

1. Identify and promote the attributes associated with higher productivity. 

2. Identify and avoid the attributes associated with lower productivity. 


3. Develop and use rational estimating processes. 


4. Portray productivity trends. 
2.3 WORK-EFFORT 


2.3.1 Labor Claiming 


For each project that is to be used in productivity measurement and analysis, or 
estimate validation, the record of estimated and actual work-effort is needed. 
The following work-effort information should be known: 

1. The original estimate. 

2. The estimate of approved changes. 

3. The actual results. 

To record the actual results most reliably, a systematic method of accounting 
for work-effort should be used. This is commonly called labor claiming. Labor 
claiming should result in an objective and accurate record of past work-effort 
so that past projects can be analyzed objectively and accurately, and reliable 
estimates can be made for future projects. 

Labor claiming should be used to establish three measures: 

1. The net work-effort on the project. 


2. The time away from the project on authorized absence. 


3. The gross work-effort on the project. 
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Labor claiming can also be used to establish the average conversion factors for 
an organization to apply to the net and gross work-effort definitions in the 
following section. 


2.3.2 Work-Effort Definitions 


° Net Work-Hour - One hour of work by one person, including normal personal 
breaks. 


° Net Work-Month - About 174 net work-hours of work. 
e Net Work-Year - About 2087 net work-hours of work. 


° Gross Work-Year - The net work-hours normally worked by one person in one 
year. (About 1565 net work-hours). 


¢ Gross Work-Month - The net work-hours normally worked by one person in one 
average month. (About 130 net work-hours). 


¢ Gross Work-Hour - The net work-hours normally worked by one person in one 
average hour. (About 0.75 net work-hours). 


2.3.3 Work-Effort Measure 


Since the measures are all stated in terms of the net work-hour, they can be con- 
sistently interpreted if the average ratio between net and gross work-hours is 
stated for each organization. This can be most conveniently recorded and remem- 
bered as the net work-nours per gross work-month. (It should be about 130 net 
work-hours). 


Two work-effort measures are called for in this guideline. Namely, work-months 
for the development productivity measure, and work-hours for the support produc- 
tivity measure. For consistency and more natural relating to head-count, these 
measures should be stated in gross work-months and gross work-hours. 
Work-sheets are shown in Figure 12 on page 39 and Figure 13 on page 40. . 


The gross work-months or gross work-hours can generally be determined in two 
possible ways: 


1. The gross work-months or gross work-hours are recorded directly from the 
project work-effort record. 


2. The net work-months or work-hours are recorded directly from the project 
work-effort record, and are then converted to gross measures by a conversion 
factor derived from the work- effort record of the site. 


Method number two is recommended because the first method can give incorrect 
productivity results on short projects. Since vacations are usually concen- 
trated in the summer months, the work content of a gross work-month in the sum- 
mer can be significantly less than the work content of a gross work-month in the 
winter. The recommended approach avoids this problem by measuring the work con- 
tent specifically in net work-effort. - 
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2.4 ATTRIBUTES 


2.4.1 Attribute Selection 


Each characteristic or attribute of a project that might be measured and recorded 
for future analysis should be considered as follows: 


1. How important is it? 


In the context of this guideline, how significant is its expected effect on 
productivity? ® 


2. Can it be changed? 


Can the attribute be changed at the site, or is it only interesting informa- 
tion that cannot be used to effect improvement? The answers to this question 
depend heavily on level of management involved, and time available to make 
the change. A factor, such as development environment, that is not changea- 
ble by a first line manager may well be changeable by a site director of I/S. 
A factor, such as development team maturity, that cannot be changed for a 
project already underway, may certainly be changed given hiring or training 
objectives, time, and resources. Generally, if an issue is important and 
the facts are available, change can be accomplished. 


3. Is it a variable at the site? 


A characteristic or attribute that is unvarying across all the activities 
and projects at a site cannot be used to explain deviations among the pro- 
jects at the site. However, it may be needed to analyze the productivity 
differences between two sites. An attribute should not be excluded from the 
record only because it is a part of every activity and project at the site. 


The key issue is clearly the importance of the attribute to productivity. There- 
fore, all attributes that are thought to affect productivity significantly should 
be measured and recorded. 


2.4.2 Attribute Recording 


The initial approach to recording the attributes of a project or activity is al- 
most always overly simplistic. Then, the inadequacies of a simple checklist are 
discovered. Yes and No do not describe the degree to which a tool or technique 
applies to the project. It is realized that far different results should be ex- 
pected from the following extremes: 


It is interesting to note how quickly these expectations can change. For ex- 
ample, who would have seen the need three years ago, to differentiate be- 
tween subsecond response time and one or two second response time, in 
productivity analysis? 


Definitions 19 


Ci/S & A Guideline - Draft - 


For example, 


1. A mature tool, that the team has used before successfully, that can influ- 
ence 100% of the work-effort on the project. 


2. A newly released tool, being used by the team for the first time, that is po- 
tentially applicable to only 10% of the work-effort. 


A technique for recording these levels of applicability is needed. Therefore, 
the following information should be recorded for each attribute recorded for 
analysis: 


e Maturity of the tool or technique? 


- Low - Tool or technique is new. No people experienced in its use are 
available for consultation. 


— Moderate - Tool or technique has been in use long enough that people ex- 
perienced in its use are available for consultation. 


~= High - Tool or technique has been in use long enough that experience has 
been incorporated in improvements to the tool or technique. 


¢ Maturity of the project team in regard to the tool or technique? 
r Low - Project team has not used the tool or technique before. 
— Moderate - Project team has used the tool or technique once before. 


Ss High - Project team has used the tool or technique more than once 
before. 


¢ Applicability of the tool or technique to the work-effort on the project? 


= Low - Tool or technique is potentially applicable to less than 1/3 of 
the work-effort on the project. 


- Moderate - Tool or technique is potentially applicable to between 1/3 
and 2/3 of the work-effort on the project. 


-~ High - Tool or technique is potentially applicable to over 2/3 of the 
work-effort on the project. 


A form for recording these attributes is shown in Figure 14 on page 41. This re- 


cord will provide the information to more accurately weight the contribution to 
productivity expected from the tool or technique. 
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3.0 FUNCTION POINTS CURRENT PRACTICES 
3.1 GENERAL 


3.2 FUNCTION POINTS MEASURE 


The following numbered paragraphs provide the current recommended practices in 
IBM I/S for classifying the complexity and counting the five major data or con- 
trol types, adjusting for processing complexity, and calculating Function 
Points: 

1. External Input 

2. External Output 

3. Logical Internal File 

4. External Interface File 

5. External Inquiry 

6. Processing Complexity 


7. Function Points Calculation 


These current practices are based on the definitions in Section 2.2 and are in- 
tended to provide more objective consistency among individuals and sites in mea- 


suring work-products with Function Points. Where current practices are provided © 


each of the numbered paragraphs will follow a similar format: ~~ 
1. Objective definitions of complexity classification. 
2. A checklist of potential data or control.types. 


3. Specific counting recommendations for particular described data or control 
types. 


Since the current practices are interpretations based on the definitions in Sec- 
tion 2.2, any issues not covered in the current practices must be resolved by 
use of the definitions. . 
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3.2.1 External Input Type 


Complexity Classification: 








DET = data element types 


bry 
ar 
es) 

i] 


file types referenced 
RET = record types 

S = simple 

A = average 

C = complex 


Additional complexity factors: 





Consider the following factors 
relative to average to adjust 
the complexity up or down not: 
more than one level: 

o Automatic cursor movement 

o Other human factors 


o Data conversion 


o Application performance 


Figure 2. External Input Type Complexity. 


Potential Input Types: 


to 


12) 


12) 
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Keyed Document | fe) Switch 
OCR Document | o Digital Sensor 
Screen | | o Analog Sensor 
Automatic Transaction fe) Maenatae Stripe 
Card . + ; o PF-Key 
Diskette Transaction — o Light Pen 
Paper Tape Transaction . User Application Control 
fe) 
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Counting Recommendations: 


DESCRIPTIONS: COUNT AS: 
Data Screen anptt -: «waoce a G eK SOR Be eS ye ba 
Function screen. input: + 2<6. 0 Ao le Bowe a Rice ewe ee bee he 


Function screen with multiple different functions 1 IT/Function 


Automatic data or function transactions from other applications pie 


Inquiry followed by an update input 2 °QT 3 ae TE 
Backup input with same processing logic as primary input 0 IT 
PF Key duplicate of a screen already counted as an input 0 IT 
Light pen duplicate of a screen already counted as an input 0 IT 
Two input screens with the same format and processing logic. . sme bg 


Two screens with the same format and different processing logic 2: LE 


pelection menu streen inplt ....0 2.05.0 ww bom we bee ee we 0 IT 
Selection menu screen input with save capability ....... ee 
ADF Target screen input Vag a a RS aps Pe sk de A ae ot ee A Lee sae 
ADF Key Selection Screen. input. 2c. 4 2 gee & Alm “Go Ae (0 LT 
ADF Master Rules screen input BL tas Ses Sats sae agin We, a, Gb ot wea a eee OQ IT 
Screen that is both input and output .......... 1 IT, 1 OT 


User maintained table or file implies at least 1 IT 


UsSer-eppliacation: control sanput 2. Oe 4-4) hoe Ye te ae “es Se ga 
Repeat -SCreen input ses 6. ee ee ae ce ee Gh GO Gan at “poo, Ey tg! Ve? RY Sg 0 IT 
Inpec: forms (COCK): oc - 23 gn ae Se tg te Ge i ewe oe BE Teh as Ok he es ae e's 5 ae Gee 
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3.2.2 External Output Type 


DET data element types 


3 


file types referenced 
RET = record types 

S = simple 

A = average 

C = complex 


Additional Complexity Factors: 





Consider the following factors 
relative to average to adjust 
the complexity up or down not 
more than one level: 

o Layout or human factors 

o Number of subtotal types 


o Data transformations 


o Application performance 


Figure 3. External Output Type Complexity. 


Potential Output Types: 


° 


oO 


24 
23 


Screen Report o Digital Line 
Terminal Report o Digital Actuator 
Batch Report o Analog Actuator 
Automatic Transaction o User Application Control 
Card o Magnetic Stripe 
Diskette Transaction o Invoice 
Paper Tape Transaction o Check 
Screen Message o Bill of Material 
fe) 
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Counting Recommendations: 


DESCRIPTIONS: COUNT 
O- Data. SCreen  OULDUE 2:,:¢.o.4%-id: Sete Ate i aa we a & Sis 1 
o Automatic data or function transactions to other applications . 1 
o Operator message from the application ............. 1 


o Message frame (format) for multiple error messages or 


confirmation messages associated with 1 IT .......... 1 
o Individual error message output within a message frame .... 0 
o Individual confirmation message output within a message frame . 0 
Oo. Baten. printed 2eport: os. in: os at Re Bk we a) Re SO Ww BRE ee eA 1 
O Bate 2Un \TEpPOre. 4 2. 4.3 nS) 4 Ane el ae & a a Om oa He eos af 
Oc BaACCRGETOr: TEPOr 4. -:  Ae eo eee he ae. Be oe Se ie Se ee 1 
o Terminal printed report a ae Ae ee ee ee ee ey eT al 
O-CONETON. TObAL-OUUBUE. 6 ce ne ae ek Gee eB We ee os Ge SRS 1 
oO Audit. list -or-check list report -. -s..4.0% ww wow A ce ek Rs 1 
o User maintained table or file ee er ee eae implies at least l 
6 Selection ment. Séreen output: 24 <2 26 ee Boke Ge s+ Soe ~O 
o Selection menu screen output with save capability ....... I 
OG ADF men Outpat 2 wick ae: Se eisge ee ee le a ue ae “ee Bs 0 
o ADF Key Selection screen output .........-...242.. 0 
o ADF Master Rules screen output .........+...244.. 0 
o Repeat sSereen-outpul ko ee) wo ea ae Sow SA we Ce Bee 0 
O. Start Sereen output: % 4. 4--4e0 sl AOS OP A A ee BO a WE me 1 
o End screen output Bo tab, OH, ae WOE ee ge TA ae ae oS ea eg a oe, es a 1 


AS: 


OT 
OT 


OT 


OT 


OT 


OF 


OT 
OT 
OT 
OT 
OT 
OT 
OT 
OT 
OT 
OT 
OT 
OT 
OT 
OT 


OT 
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3.2.3 Logical Internal File Type 





DET = data element types 


ap 
| 
wa 

ll 


file types referenced 
RET = record types 

S = simple 

A = average 

C = complex 


Additional Complexity Factors: 





Consider the following factors 
relative to average to adjust 
the complexity up or down not 
more than one level: 

o Application performance 

o Search Criteria 


o Recovery and backup 


Figure 4. Logical Internal File Type Complexity. 





Potential File Types: 


o Logical Internal File o File for Control of 


Batch Sequential Processing 


o Data Base 


o File for User Query 


o User Table 
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Counting Recommendations: 


DESCRIPTIONS: COUNT 
o Logical entity of data from user viewpoint 1 
o Logical internal files generated or maintained 
by the application . 1 
o Files accessible to the user through keyword(s) or parameter(s) 1 
o User maintained table or file . t 
o File used for data or control by sequential (batch) application 1 
o Each hierarchical path (leg) through a data base (include paths 
formed by secondary indices and logical relationships) 1 
o Hierarchical paths not stated in the user requirements 0 
o Intermediate or sort work file | 0 
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3.2.4 External. Interface File Type 





DET 
FTR 
‘RET 


data element types 


file types referenced 
= record types 

simple 

average 


complex 


Additional Complexity Factors: 


Consider the following factors 


relative to average to adjust 
the complexity up or down no 
more than one level: 


o Application performance 


o Search criteria 


o Recovery and backup 


o Multiple distribution 


Figure 5. External Interface File Type Complexity. © 


Potential Interface File Types: 


o Logical Internal File Access- 
ible from Another Application 


o Logical Internal File Access- 
ible to Another Application 


o Shared Data Base oO 
fo) ° 
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3.2.5 External. Inquiry Type 
Counting Recommendations: quiry Vyp 


DESCRIPTIONS: COUNT AS: 
o File of records from another application ........... 1B 


, Input Part: 
o File of records to another application, even though 


counted as 1 FT in this application ........-+.2+46. i El 
o File of records to multiple other applications Ree eeyer a ceo 
(multiple distribution is a complexity consideration) .... 1 EI FTR = file types referenced 
o Data base shared to other application. ..........0.. 1: EL RET = record types 
o Data base shared from other applications ..°......... 1 EI s = eats 


A = average 


C = complex 





Additional Complexity Factors: 
Output Part: 
Consider the following factors 
relative to average to adjust 
the complexity up or wuown not 


er more than one level: 
CO 
€> o Automatic cursor movement 


o Layout or other human factor 
o Application performance 
o Number of subtotal types 


o Data transformations 





Figure 6. External Inquiry Type Complexity. 


Potential Inquiry Types: 


o User Inquiry with o ADF Menu 
NO File Update 
o ADF Key Selection Screen 
o Help Message and Screen 
o ADF Master Rules Screen 
o Selection Menu Screen 


oO 
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3.2.6 Processing Complexity 
Counting Recommendations: 


DESCRIPTIONS: COUNT AS: (No recommended Current Practices). 
o Online input and online output with no update of data in files 1 QT 
o Inquiry followed by an update input ............41QT, 1/1T 3.2.7 Function Points Calculation 
o Help screen input and output ............084884848 1 QT 
(No recommended Current Practices). 
o Selection menu screen input and output ............ 1 QT 
oO ADE menu. dnput: and (OULpUub: a. ~ 4a pi ee a es Ee 1 QT 
3.3 WORK-EFFORT 
o ADF Key Selection screen input and output ........... 1 QT 
o ADF Master Rules screen input and output ........... #1QT (No recommended Current Practices). 


o A major query facility or language should be decomposed into 
its hierarchical structure of IT(s), OT(s), and QT(s) using 
the existing definitions and current practices. 3.4 ATTRIBUTES 


(No recommended Current Practices). 
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4.1 FUNCTION POINTS CALCULATION 


Application: : Appl ID: 
Prepared by: bof Jo Reviewed by? \. 254 — ho ee as 


Notes: 


o Function Count: 












Complexity 














Description 













[External Input SEE) oh JU sane Seatac Oe, ee 
{External Output ase Oe geet ee ae 1 Ss ae a a I Pe 
FT |Logical Internal File |_W.. x 7 = __|__ x10 = __|]... x15 = __ 
EI jExt Interface File Boe RUSS le TOS ce he 10 = 
QT jExternal Inquiry SD ae ee ST <e— oer oe 








o Processing Complexity: 
ID | Characteristic DI ID Characteristic DI 


C1 !Data Communications a | C8 |Online Update ee, 
C2 |Distributed Functions _ C9 |Complex Processing a 
C3 |Performance — C10 |Reuseability — 
C4 |Heavily Used Configuration | __ | {C11 |Installation Ease ak 
C5 ;Transaction Rate ae C12 |Operational Ease — 
C6 |Online Data Entry = C13 |Multiple Sites = 
C7 |End User Efficiency ion C14 |Facilitate Change = 


PC Total Degree of Influence aed 








o DI Values: 


- Not present, or no influence = 0 - Average influence = 3 
- Insignificant influence = 1 - Significant influence = 4 
- Moderate influence = 2 - Strong influence, throughout = 5 
PCA Processing Complexity Adjustment = 0.65 + (0.01 x PC) = 
FP Function Points Measure = FC x PCA = 


Figure 7. Function Points Calculation Worksheet 
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4.2 IN.,-OUT., INQ., FUNCTION AND COMPLEXITY RECORD 


App Liat tons) .. se ke a Se et Appl ID: 
Prepared DY) 2 es tf fs Reviewed -by* 2.232 
Notes: 

In., Out., Inq., Function List Complexity Record 






Before 





Type| ID |Ref Description 








Ce ee ne a nt ikem Tee ee 
ern ft fe | eres: | een feet fc | neem 
cee | cemereenee | mee fee | eeermmeememm | nem fete | meme 


nt NAR tn EE A ORR A A 


CEE EC EICUIS SIE EET e 
LEVEE EEC EDHELMEB EI EBLE Et 
PULTE EEE EEE 





DET = Number of Data Element Types in the In., Out., Inq. 
FTR Number of File Types Referenced by the In., Out., Inq. 
Add., Del., Chg. = Complexity of the In., Out., Inq. added, deleted changed. 


Figure 8. IN., OUT., INQ., Function and Complexity Record Worksheet 
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4.4 DE PMENT WORK-PRODUC 
4.3. FILES, INTERFACES, FUNCTION AND COMPLEXITY RECORD EVELOPM W RODUCT 


ee Boplieation® “2. te ee eS Appl ID: 
Boys At OT a Appl ID: og oe 
Prepared by: _...——sti‘(‘CCOCUL L/L. «CO Reviewed by: _s—/_ fl. 
Prepared: bys) 20.2. = os J J oy 'ReVEeWER. DY wot ee ee ee ff F 
Notes: 
Notes: 


o Added Function Count: 


Description 


Files, Interfaces, Function List Complexity Record 


External Output 
DET|RET|Del|Chg| DET] RET| Add] Chg 


Logical Internal File 


CO Ee COREE 2 


Type; ID Description 


[oe 





Ext Interface File 
External Inquiry 





o Changed "Evaluated After" Function Count: 


ane etre ene RR I 





IT {External Input Bhs I te ee es EO ee Se 
OT |External Output Sake FS ce Pe ce en RS ee he 
FT |Logical Internal File |_W x 7 = __j__ x10 = __!|]___sxd5 = Ls} Le 
EI |Ext Interface File a ee ees a OS Sa ete 
QT | External Inquiry Son aos 6By Ss eae ee ES mat pensions 
er 
ma ChgA| Total Changed "After" Unadjusted Function Points | ae 
5 
o Deleted Function Count: 
External Input ea KOS ee SE a ROD Se es 
|External Output Cee RN kh SN a St so et 
Logical Internal File x7 = x10 = x15 = | 
[Ext Interface File ese OF ea Pe ee ae 
‘External Inquiry gee OO eee OO Pe ee, Me Oe a ne 
Del | Total Deleted Unadjusted Function Points | eee 


PULTE 
CE Eee ONES Eee 


POA SSIES alia eb BENG Wee h 





DERAOASRORGRGRERORERAORORORRD 


DEV Development Work-Product FP Measure = (Add + ChgA)PCA + (Del)PCA = 


DET = Number of Data Element Types in the Files, Interfaces. 
RET = Number of Record types in the Files, Interfaces. 
Add Del., Chg. = Complexity of the Files, Interfaces added, deleted, changed 


Figure 10. Development Work-Product Function Points Worksheet. 


Figure 9. FILES, INTERFACES, Function and Complexity Record Worksheet 
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4.6 DEVELOPMENT OR ENHANCEMENT WORK-EFFORT RECORD WORK-SHEET 
4.5 SUPPORT. WORK=PRODUCT 


Application: ; Appl ID: 
POU RCAC OTe, ha oe a ee Appl ID: as 


Prepared by: __/__/__. Reviewed by: Sif Af aa 
Prepared by: Pio} oid Reviewed: DY j.2. es ff eae 2 pat 


NN | oem 


Complexity 


Average Complex 


o Added Function Count: 
Development or 

Enhancement Initial Approved | Final 
Standard Tasks: Estimate Changes Estimate 


gwm gwm gwm 


[eaguisenens | | | | 


System Design 
External Design 
Internal Design 


Description 


IT |External Input 


OT j|External Output 

FT |Logical Internal File 
EI |Ext Interface File 
QT | External Inquiry 


Hou wd wu 
Wow We ie a 
Hou uw ue 


ttc, 
nd 







Add | Total 


o Changed "Evaluated After" Function Count: Program Development 
Detail Design 

Coding 

Unit Test 

Program Integration 


[Sistem Tee | 
Ue eee eee 


IT [External Input 

OT |External Output 

FT |Logical Internal File 
EI |Ext Interface File 

QT |External Inquiry 


qs 
ae) o Deleted Function Count: User Education 


IT |External Input | , 
OT j|External Output 
FT |Logical Internal File 


File Conversion 


EI !Ext Interface File 
QT |External Inquiry 





Non-Standard Tasks: 


a a ee 
Package Modification | ar eee EEE bees | 
fone | 


{ 
Total Changed "Before'’ Unadjusted 


SPT Support Work-Product FP Measure = Orig FP + (Add + ChgA)PCA 












IT |External Input 
OT |External Output 
FT | Logical Internal File 





EI |Ext Interface File 
QT |External Inquiry 





Net Work-Hours per Gross Work-Month pe WH 
- (Del + ChgB)PCA = 


Figure 12. Development or Enhancement Work-Effort Record Worksheet. 


Figure 11. Support Work-Product Function Points Worksheet. 
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4.7 SUPPORT _WORK-EFFORT RECORD WORK-SHEET 


Application: : Appl ID: 


Prepared .by@. 2.2 <n e e J J  REVEWEd DY! x es 


Annual Work-Effort Record in Gross Work-Hours - gwh 












Maintenance or 
































Support Initial Approved Final Final 
Standard Tasks: Estimate Changes Estimate Actual 
gwh gwh gwh gwh 






Application Support ee a ee 


nanan: Pa, enemies jets | come 


SUPPORT TOTAL eee 
Annual Support Record 


Total Annual 

Enhancement 

Activity 
FP 














Application History: Year-End Support 


Work-Product 


Annual Support 
Work-Effort 






















FP gwh 


| End-of -Deve lopment RRO TER ETE: eee ee LITILTTTTTTT 
|p| 





Yr 
| Yr 8 | 
| Net Work-Hours per Gross Work-Month oh 


Figure 13. Support Work-Effort Record Worksheet. 
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4.8 ATTRIBUTES RECORD WORK-SHEET 


Application: : Appl ID: 
Prepared by: ; __/__/__. Reviewed by: sy fee Aye 


Notes: 


Applicability Level 


Attribute Description 


Attr 
Appl 


Attr Team 
Matu Matu 











Factors: (See Section 2.4.2). 

Attr Matu = Maturity of the Attribute. 

Team Matu = Maturity of the Team regarding the Attribute. 

Attr Appl = Applicability of the Attribute to the Work-Effort. 
Instructions: (See Section 2.4). 

1. List the Attributes of the Project expected to have a significant effect 
on productivity. 


2. Record the Applicability Level of each of the Factors using the definitions 
in Section 2.4.2.(Low, Mod, High, or NA). 


Figure 14. Attributes Record Worksheet. 
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AD/M MATURITY GRID 
07-01-83 


Introduction: 


Management is responsible for establishing the purpose of an operation, deter- 
mining measurable objectives, and ensuring that the necessary actions are taken 
to achieve those objectives. This is as true for the AD/M (Application Develop- 
ment and Maintenance) operation as it is for other operations. 


Management of the AD/M operation is sometimes erroneously viewed as being hard 
to define and measure. It is often seen as a "“level-of-effort" operation rather 
than a planned operation with specific, expected, and measured objectives and 
results. The "folklore" sometimes assumes that if you assign enough "good" peo- 
ple to the AD/M task, you will have done all that is managerially possible to- 
ward achieving excellence in AD/M. 


When we accept these views, we mislead ourselves about what might be done to im- 
prove the AD/M operation. AD/M management has become too important to leave to 
chance. Thus it is necessary that we have ways of portraying the character or 
level of maturity of our AD/M operations. 


As a first step, an AD/M Maturity Grid has been developed.’ It is designed to 
heip determine where the AD/M operation (or site) stands. By selecting a varied 
set of participants for the grid evaluation, the results can portray the views 
of different levels of the AD/M organization or different departments; the per- 
ceptions of the user can also be contrasted to those of the AD/M organization. 
With such a portrayal, a manager can deduce the need for, determine the nature 
of, and initiate programs to take the site to maturity and excellence, 
Step-by-step. 


How It Works: 


Along one dimension, the grid is divided into five levels of maturity. Along 
the other dimension, five categories and 25 subcategories of AD/M activities and 
considerations are listed. Using the description in each box, it is possible to 
identify where the operation is now, and to plan improvements to take the opera- 
tion to the next level. 


The Summary Grid shows the relationship among the grid scale, the grid levels, 
and some descriptive names for the grid levels. A general statement in each box 
of the summary grid shows the general relationship of the categories and the 
grid levels. 


The scale between O and 5.0 provides a convenient description of the scale posi- 
tion of maturity. If the statements, about your unit, in a box are all positive, 
the grid position is at least the upper bound of the box. If the statements, 
about your unit, in a box are all negative the grid position is at most the lower 
bound of the box. Combinations of positive and negative statements, in a box, 
would give a grid position between the extremes just described. (For example, a 
scale position of 2.5 would indicate, that the site had complied with the state- 
ments in the boxes at levels 1 and 2, and half the statements in the box at level 
3). With this scale, the scale position of each category can be determined by 
averaging the five related subcategories. The Overall Maturity Index can be de- 
termined by averaging the five categories. 


Similar to the Quality Management Grid in "Quality Is Free" by Philip B. 
Crosby. 


2 AD/M Maturity Grid 


AD/M MATURITY GRID 
AD/M MATURITY GRID 07-01-83 


07-01-83 


; : Summary Grid 
The ‘pages following the Summary Grid are the AD/M Maturity Grid. The defi- 
nitions are keyed to the subcategories and a worksheet is provided as a conven- 
ient record of the evaluation. 0 1.0 2.0 3.0 4.0 5.0 
a a ee ee ee 












LEVELS 1 2 3 4 5 
CATEGORIES |UNCERTAINTY | AWAKENING |ENLIGHTENMENT| WISDOM MATURITY 
RECOGNIZE FULLY | EXCELLENCE 
POSSIBILITIES |ACTIVE UNDERSTAND |IS AN 
MANAGEMENT |NO IMPROVEMENT -|BENEFITS | INTEGRAL 
CONSISTENCY |NO ACTION PROGRAM PART OF 
COMMITTED PERSONAL ‘|SITE 
ACTION OPERATION 
NO | 
CONSISTENT | RECOGNIZE BENEFIT AND CONSISTENT 
RESOURCES |MEASURES NEED COST USED ALL MEAS / ANAL 
FOR ACTIVITY | INTEGRAL 
EXPENSE PRIMARILY PLANNING MEASURED |TO SITE 
MAY BE CONTROL OPERATION 
TRACKED 





























NO MAJOR BENEFIT OF |QUALITY, 
CONSISTENCY |RECOGNIZE EFFORTS DISCIPLINED|ON TIME, 
PROCESSES POSSIBILITIES | FOLLOW PROCESSES |WITHIN 
EACH DOES SELECTED WIDELY BUDGET ARE 
OWN THING  |SOME USE | PROCESSES | UNDERSTOOD | ROUTINE 
_ | USED | | 
, RECOGNIZE THROUGHOUT | 
STANDARDS USEFULNESS USED ON MANAGEMENT | 
& ‘DO NOT EXIST/BUT LEFT TO |MAJOR REGULAR RESOURCES, 
GUIDELINES |OR NOT USED | INDIVIDUAL EFFORTS FEEDBACK __| PROCESSES, 
PROJECTS TO KEEP STANDARDS 
CURRENT & GUIDE- 
AND USEFUL |LINES AND 
TOOLS & 
| RECOGNIZE ROUTINE TECHNIQUES 
SPORADIC USE|USEFULNESS OF |GROWING USAGE OF 
TOOLS COORDINATION |COORDINATED |WELL ALL 
& RESULTS NOT | SET IN SELECTED | INTEGRATED | 
TECHNIQUES |UNDERSTOOD | SHORT TERM PLACE TOOLS AND 
|EFFORTS TRIED TECHNIQUES 
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Worksheet: 


AD/M MATURITY GRID 


Site: 


Overall Index 


Management 


Resources 


Processes 


Businesslike Mgmt of AD/M 
AD/M Improvement 
Exec/User/I/S Mgmt Involve' 
Business Case 

Application Backlog 


Effort Tracking 
Accomplishment Tracking 
Productivity Measurement 
Estimating 

Job Satisfaction 


Fundamental Approaches 
Project Management 

AD/M Methodologies 

AD/M Architecture 
Obiective Outside Review 


Stds & Guide’ 


Management 

Resources 

Processes 

Standards & Guidelines 
Tools & Techniques 


Tools & Tech' 


Management 

Resources 

Processes 

Standards & Guidelines 
Tools & Techniques 


07-01-83 


Date: 


AD/M MATURITY GRID 
07-01-83 


Category: Management 


The management category relates to the overall businesslike management of AD/M 
resources, projects, and activities. A key concept is the prediction and meas- 
urement of benefits on an equal basis with quality, costs, and schedules. This 
enables objective identification, prioritization, and selection of the applica- 
tions to be developed, enhanced and supported. Another key concept is the need 
for active involvement of User (Functional), I/S (Data Processing), and Execu- 
tive (Both) management with defined responsibilities; Executive and User 
management being responsible for the overall direction setting, business func- 
tion, benefits, and affordability, and I/S management being responsible for the 
technical feasibility and the management of the development and maintenance ac- 
tivities. 


AD/M Improvement is included as a management responsibility to continually 
evaluate and improve the excellence of the organization. 


Consider whether User and I/S management are sensitive to the other's problems, 
and understand the other's capabilities. Consider the attention given to: the 
long range structure and responsibilities of I/S and the User, new approaches 
to delivering I/S Services (such as,information center concepts), new opportu- 
nities (such as, office automation), and the need for continuing cross-education 
between the User and I/S. 
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AD/M MATURITY GRID 
07-01-83 


Category: Management 


Subcategory: Businesslike Management of AD/M covers the site management con- 
siderations and actions to balance business needs, priorities, and affordability 
to have AD/M do the right things as efficiently as possible. 


Grid Level Descriptions: 


No effective businesslike management of AD/M. Executive and User manage- 


ment do not understand or manage, their AD/M resources, and development and 
support opportunities. 


User, Executive, and I/S managers begin to recognize the need for business- 
like management of AD/M; that is, the need to understand and manage re- 
sources, costs, and benefits. They begin meaningful dialogs to that end. 


Formal written commitments and guidelines are provided for businesslike 
management of AD/M. Benefit value and resources are determined and managed 
for major AD/M projects. User, Executive, and I/S management commitment is 
reflected in their actions. 


Businesslike management of AD/M is consistent and routine in the organiza- 
tion. Delegation within levels of User, Executive, and I/S management main- 
tains perspective and balance between control, cost, and responsiveness for 
all AD/M projects. 


A consistent and routine plan and strategy, based on value-justified AD/M 
projects provides a strong base for businesslike management of AD/M. Objec- 
tives and measured results for both benefit value and cost are used to guide 
decisions to initiate or change all AD/M projects. 
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Note: For grid position determination see last paragraph page 2: 


AD/M MATURITY GRID 
07-01-83 
Category: Management 


Subcategory: AD/M Improvement considers organized and stable ways to intro- 
duce effective changes into the AD/M function. 


Grid Level Descriptions: 





Problems are fought only as they become unavoidable. Characteristics might 
be: inadequate definition; lots of yelling and accusations; no organized 
activities; no resolution; waiting for problems to go away. 


Teams are set up to attack major problems, but root causes are not recog- 
nized. Symptoms are treated as problems. Obvious "motivational" short 
range efforts are tried instead of long range solutions. 





Major problems are faced openly and resolved in an orderly way. Special ef- 
| forts to find root causes. Implementation of an AD/M improvement program as 
an excellence program begins. 


Ol 


Problems and opportunities are identified early. All functions are open to 
suggestion and improvement. An effective AD/M improvement program is an in- 
tegral part of the operation. 





4& 
AD/M improvement and excellence is a normal and continuing activity. All 
trends are moving in the right directions. Special corrective measures no 
longer necessary because feedback and correction occur as a routine function 
of management reporting. 

5 





Note: For grid position determination see last paragraph page 2: 
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AD/M MATURITY GRID 
07-01-83 


Category: Management 

Subcategory: Exec/User/1/S Management Involvement covers the need for Execu- 
tive, User, and I/S management to understand the needs and priorities of the bu- 
siness and the capabilities and accomplishments of AD/M and direct AD/M 
effectively. 


Grid Level Descriptions: 









User and Executive management are, either, uncertain about the capability 
and accomplishments of AD/M, or are convinced that AD/M is not performing to 
its potential. Neither of these feelings are based on objective measure-~- 
ments. 


User, Executive, and I/S management recognize the potential of an effective 
AD/M process to improve AD/M effectiveness. They further recognize the po- 
tential of an effective AD/M organization to help improve their business. 


User, Executive, and I/S management have an objective perspective of the va- 
lue and potential of AD/M to their operation and the company, based on meas- 
ured results. They participate in reviews and decisions on major projects. 


User, Executive, and I/S management understand, accept, and perform their 
responsibilities relative to AD/M. They are involved in business cases, 
project objectives, project results, success trends, and productivity 
trends. 


User, Executive, and I/S management have an excellent perspective of the va- 
lue of AD/M. They regularly receive (and give) executive level reports on 
the current status and trends in value and success of AD/M. 


S 


Note: For grid position determination see last paragraph page 2: 


AD/M MATURITY: GRID 
07-01-83 
Category: Management 
Subcategory: Business Cases provide for systematic consideration of the bene- 
fits, costs, affordability and priority of alternatives when deciding on initi- 


ation or change of an AD/M activity. 


Grid Level Descriptions: 





Business cases are not consistently used to justify and prioritize projects. 
Most AD/M projects are claimed to be mandatory, and no consistent attempt is 
made to put a value on the expected benefits. Priorities may shift frequent- 
ly and unpredictably. 


Recognition that business cases can be valuable in guiding decisions and 
setting priorities. Some guidance to develop business cases has been docu- 
mented and provided. 





Z 
For major projects, business cases are required and used to justify and pri- 
oritize AD/M efforts. Benefits are beginning to be measured, just like 
costs and schedules. Priority setting and business case guidance has been 
documented and provided for projects of all sizes. 

3 





Business cases are consistently used to guide all application development 
priorities and AD/M plans. Benefits are consistently measured on all AD/M 
projects. 





The value of AD/M is measured and demonstrated as a regular part of AD/M bu- 
siness management. The measured benefits are used to feed back results to 


improve future business cases as in the case of cost and schedule 
estimating. 





Note: For grid position determination see last paragraph page 2: 
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AD/M MATURITY GRID 
07-01-83 
Category: Management 
Subcategory: Application Backlog - a prioritized list of applications under devel- 
opment and to be done, that provides an organized and complete base for 


planning. 


Grid Level Descriptions: 





No formal application backlog management to identify, study, plan, prior- 
itize, and schedule future applications to be.developed or enhanced. There 
may be no identifiable application backlog. 


Recognition that collecting and organizing application backlog information 
is necessary. 


Listing, prioritizing and maintaining the application backlog based on ben- 
efit, cost, and affordability is done for major projects. 


All AD/M projects are prioritized in the application backlog based on 
benefit, cost, and affordability. The selected projects have been studied 
and are "ready to start" as current projects are completed. 


The application backlog is a consistently used management tool so that bene- 
fit, cost, priority, and affordability decisions can be made with stability. 
AD/M people look forward with confidence to starting their next project as 
planned. 


5 


Note: For grid position determination see last paragraph page 2: 
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AD/M MATURITY GRID 
07-01-83 


Category: Resources 


The Resources category relates to the management of AD/M resources with full 
emphasis on the people resource and functional excellence. Work-effort tracking 
and accomplishment tracking are covered as two separate concepts, both of which 
must be understood to provide the full status of a project or activity. Combin- 
ing the data of work-effort tracking and accomplishment tracking also is the key 
to rational estimating and productivity measurement. But, the key concept to 
management of AD/M resources is professional job satisfaction. Job satisfaction 
tests the balance between reasonable challenge and undue pressure. It is the 
key differentiator between "working smarter” and only "working harder". 
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AD/M MATURITY GRID 
07-01-83 


Category: Resources 


Subcategory: Effort Tracking - an accurate and appropriately detailed record 
of where work-effort has been used, to provide a base for productivity and quali- 
ty measurement and estimating. 


Grid Level Descriptions: 


No consistent knowledge of where work-effort is being used (which tasks). 
Work-effort may be tracked by headcount only. 


Recognize need for tracking work-effort on projects (development and period 
support), tasks, and phases. Require work-effort tracking on major 
projects. Initial measurement and data gathering system in place. 


Major projects track work-effort by task and phase. Improved knowledge of 
the work-effort applied to specific tasks allows effort to be better di- 
rected. 


Much of AD/M work-effort is used in controlled projects and period support 
with documented objectives and records of results. New development and en- 
hancement is clearly differentiated from support and fixing. Work-effort 
information is consistently used to plan new efforts, and understand "cost 
of quality" (e.g., prevention, testing, and rework). 


Virtually all AD/M effort is spent on development and period support pro- 
jects. Management knows specifically where all work-effort is being used. 
Work-effort information is used as a natural management tool in 
preparing/changing AD/M plans and demonstrating AD/M trends. 


> 


Note: For grid position determination see last paragraph page 2: 


13 


AD/M MATURITY GRID 
07-01-83 


Category: Resources 


Subcategory: Accomplishment Tracking - an accurate and appropriately detailed 
record of the completion of tasks and objectives, to provide a base for produc- 
tivity measurement and estimating. 


Grid Level Descriptions: 


Consistent, quantitative measures of technical progress are lacking or are 
ineffective, leading to unacceptable surprises at the expected completion 
or major milestones of projects and assignments. 


Recognize need for planning and tracking capability for tasks, assignments, 
and projects. Task planning and tracking procedure is selected and provided 
for major projects. Its use is still inconsistent and does not cover all 
projects. 


Major projects plan, track, and report technical status by tasks planned and 
tasks completed. Deviations from plan are used to recognize, diagnose, and 
fix problems. 


For most tasks, assignments, and projects, quantitative tracking results are 
used to develop and update estimating guidance. Most projects and period 
support activities track and report project status by tasks, and use meas- 
ured deviations from plan to detect, diagnose, and fix problems. 


40°6735——eee—e—ee ere anna 


Task tracking information is used as a natural management tool in 
preparing/changing/achieving AD/M plans and demonstrating AD/M trends at 
all levels and throughout the whole AD/M organization. 


| 
| 
a 


Note: For grid position determination see last paragraph page 2: 
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AD/M MATURITY GRID 
07-01-83 


Category: Resources 


Subcategory: Productivity Measurement - a relative measurement that relates the 
work completed to the resource or effort expended, used to improve the AD/M 
function, to estimate future work more accurately, and to measure the effects of 
specific programs, such as, “quality improvement”. 


Grid Level Descriptions: 


No consistent measurement and analysis of the productivity of AD/M people. 
Definitions of work-product output and cost are lacking or are inconsistent. 


Recognize need for measurement and analysis of productivity in AD/M. Ini- 
tial definitions of work-product output and effort are established. Defi- 
nitions tend to relate to current technology, language, and techniques, 
limiting long-term applicability. 


Major projects are measured and results are used to determine initial pro- 
ductivity trends. Recognize weakness of work-product output definitions 
limited to current technologies or techniques. A more functional approach 
is adopted (e.g., function points, or some equally effective approach). 


Productivity trends can be demonstrated by quantitative functional meas- 
urements. Positive influences can be identified and encouraged; negative 
influences can be identified and avoided. 


Productivity measurement and analysis is routinely used to: demonstrate 
progress; identify factors to encourage/avoid; select technologies, tech- 
niques, and approaches; provide estimating and validating guidance; and 
justify business cases. Trend is positive. Site is recognized as a leader 
in new techniques. 


a a em a as See 


Note: For grid position determination see last paragraph page 2: 
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AD/M MATURITY GRID 
07-01-83 
Category: Resources 
Subcategory: Estimating - analysis and planning that relates productivity mea- 
surement and plans to predict the resources and schedule required to accomplish 


an objective, on time, within budget, and meeting requirements. 


Grid Level Descriptions: 





Work may be started without estimates, or no estimates may ever be provided. 
Where provided, estimates may be based only on personal experience. Crite- 
ria and guidelines for estimating are inconsistent or dont exist. 





Recognized need for estimating guidance distilled from the experience of 
successful estimators and project managers. Development of estimating doc- 
umentation and guidelines started, including: objectives, plans, changes, 
tracking, tasks, results, feedback and, models. 


to 





Major projects have a rational validated estimate, project plan, and change 
control. The outcome is analyzed and the deviations from the estimate are 
determined and analyzed consistently. 





| 


| Most projects are consistently being completed within 10% of the initial es- 
timate plus approved changes, and measured results prove it. Results from 
completed projects are consistently used to update estimating guidance. The 
guidance is distributed to everyone in the AD/M organization. 





| 
| 
| All projects are consistently within 10% of the original estimate plus ap- 
| proved changes. A broad spectrum of estimating and validating guidance, 
| based on completed projects, is regularly provided for all levels in the or- 
ganization (department, function, site). 


a 


Note: For grid position determination see last paragraph page 2: 
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AD/M MATURITY GRID 
07-01-83 
Category: Resources 


Subcategory: Job Satisfaction - a relative measure that can demonstrate the 
trend in professional satisfaction of AD/M people with their job. 


Grid Level Descriptions: 










Little, or no, attention is paid to job satisfaction trends. The job satis- 
faction section of the Employee Opinion Survey may be discussed in depart- 
ment feedback meetings, but there are few systematic attempts by management 
to analyze the trends and relate them to improvements, or need for improve- 
ments, in the AD/M processes. 


Trends in the job satisfaction section of the Employee Opinion Survey, for 
example, begin to be systematically analyzed by management, to establish 
the correlation between job satisfaction and improvement, or need for im- 
provement, in the AD/M processes. 


2 
Trends in job satisfaction can be correlated by management with the demon- 
strated needs and accomplishments of the AD/M organization. Positive fac- 
tors are encouraged. Negative factors are fixed. 

3 
Trends in job satisfaction are regularly analyzed and used by management to 
improve the AD/M processes, as naturally as other measures of accomplishment 
are used. 

4 
Morale is consistently excellent. Feeling of confidence, professionalism, 
excellence, accomplishment, and job satisfaction are all at high levels. 

5 


Note: For grid position determination see last paragraph page 2: 


AD/M MATURITY GRID 
07-01-83 


Category: Processes 


The Processes category relates to the management of the processes by which the 
AD/M work is accomplished. Key concepts are: the Fundamental Approach of a 
structured management process continuously improved by analysis of data fed back 
from previously completed projects and efforts; and management of AD/M efforts 
by Project Management with specific objectives, controls, and expected results. 
Direct delivery of data and function to the user by information center concepts, 
and broader reuse of "available code" are emphasized as growing alternatives to 
new development in AD/M methodologies. Development center concepts and AD/M 
Architecture provide a more effective way to accomplish new development. Risk 
Assessment and Independent Review explore the value of Objective Outside Review 


as a help to the project team and user in successfully.completing their assigned 
projects. 
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AD/M MATURITY GRID 
07-01-83 


Category: Processes 


Subcategory: Fundamental Approaches - the structured management processes 
used to accomplish the AD/M function. 


Grid Level Descriptions: 


No step-by-approved-step AD/M process is documented, consistently fol- 
lowed, or encouraged. Individual managers follow individual processes. 
Lack of consistency causes most efforts to be.treated as unique happenings. 
Quality is addressed by rework after installation. 


Recognize need for a documented AD/M process. A rudimentary process is ap- 
plied to general phases but there are no consistent, agreed-to definitions 
of each phase, activity, or management procedure to be used. Control of 
quality is achieved by testing at the end of the process. Mostly applied to 
major projects. 


A step-by-approved-step AD/M process is selected, documented and installed. 
It is based on: user and AD/M understanding; planning, tracking, and re- 
porting to results based on meeting commitments: schedule, cost, and spec- 
ifications (quality). Control of quality achieved by preventive measures, 
such as, inspections or walkthroughs. 


AD/M and user people see the value to their organizations in the documented 
AD/M process, and use it effectively to solve problems, get and hold agree- 
ment, and complete AD/M efforts successfully. The process is designed to 
provide guidance for efforts varying in size, scope, and type of activity. 
AD/M management consistently balances the trade-offs between prevention, 
testing and rework. 


All AD/M efforts follow the AD/M process keyed to continued AD/M and user 
involvement based on agreement, change control, and review and approval un- 
til the effort meets commitments or the commitments are changed. The AD/M 
process is updated regularly keeping it current with the best project expe- 
rience. 


=) 


Note: For grid position determination see last paragraph page 2: 


19 


AD/M MATURITY GRID 
07-01-83 
Category: Processes 
Subcategory: Project Management- accomplishing the AD/M function by organizing 
work into projects, and period support, with objectives, plans, and criteria for 


judging completion. 


Grid Level Descriptions: 





AD/M work is not consistently managed as projects, or period support. A ma- 
jority of it is managed as activity oriented support with undefined com- 
pletion criteria. Managers receive no consistent training as managers of 
projects. 


User, Executive, and I/S management recognize that the need to set and 
achieve specification, cost, schedule, and benefit objectives in their bu- 
siness requires an organized approach to manage AD/M. 







bo 









Specific appropriate training in managing projects is given to all AD/M man- 
agers and affected users and executives. Documented objectives approved by 
User, Executive, and I/S management are required for major AD/M efforts. 
Most correction and enhancement activity is organized into releases. 


The majority of AD/M work efforts are managed as projects or period support. 
Feedback from completed projects is consistently applied to improvement of 
the project management guidance and training. User, Executive, and I/S man- 
agement understand the value of the approach. Predictability of results 
(cost, schedule, meets specs) is improving. 


All AD/M efforts can be traced to an authorization, which covers specifica- 
tion, cost, schedule, and benefits. Delegation of the authorization author- 


ity keeps control, cost, and responsiveness in balance. Predictability of 
results is high. 







Note: For grid position determination see last paragraph page 2: 
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AD/M MATURITY GRID 
07-01-83 
Catégory: Processes 
Subcategory: AD/M Methodologies - the alternative technical approaches for de- 
livering applications more effectively, such as, information center concepts, 


use of available code, new development with a development center concepts. 


Grid Level Descriptions: 





The AD/M technical approaches are inconsistent from project-to-project, and 
depend on the fortuitous skills and experience of the individual teams. 


Recognized need for consistent methodologies, such as: standard design, 
development, implementation, and support tasks, inspections and walkth- 
roughs, and use of standard software products. Consistent methodologies be- 
gin to be used to produce applications of more consistent quality. 


Consistent methodologies are used on major projects. Information center 
concepts begin to be used to deliver data more directly to the user. De- 
signers begin to seek out and use available code. Development center con- 
cepts beginning to provide more productive environment for AD/M 
professionals. 


Consistent methodologies are used on all projects. Designers consistently 
seek to deliver more function directly to user through information center 
concepts. Standard operations environments and consistent methodologies are 
used to promote more development and use of available code. Development 
center concepts in full operation with education, hardware, and people. 


Each application development project is consistently viewed and managed as a 
potential combination of: Information center concepts (help); use of avail- 
able code (buy); new development with consistent methodologies using devel- 
opment center concepts (make). 


5 


Note: For grid position determination see last paragraph page 2: 
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AD/M MATURITY GRID 
07-01-83 
Category: Processes 


Subcategory: AD/M Architecture - the long range view of application architec- 
ture, data as a valuable asset, and consideration of data and processing. 


Grid Level Descriptions: 





No consistent consideration, of the architectural structure, of the appli- 
cations under development. Applications tend to be one-of-a-kind with no 
-consistent thought for long life and more general use. 





1 i 
Recognize need for structure to provide greater potential for general use, 
and higher probability of longer useful life. Structured design, structured 
programming and data base design are initially emphasized. 

Z 


Consistent view of application architecture begins to be applied to major 
projects. Consideration of data and processing is seen as a way to provide 
longer useful life and more general usefulness of applications. 


Data administered as a resource, is considered key to more general useful- 
ness and long life for all applications. Consistent long range view of ap- 
plication architecture forms strong base for all applications. 


4 ————___————- _—_—_—_———————rrr—————-: sO oes nn 


| AD/M methodologies and AD/M architecture are fully integrated to provide the 
most effective solutions to site application needs. New applications are 
consistently developed with a long range view to achieve more general use 
and long life. ; 

| 





5 


Note: For grid position determination see last paragraph page 2: 
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AD/M MATURITY GRID 
07-01-83 
Category: Processes 


Subcategory: Objective Outside Review - covers the review provided by systems 
assurance, independent review, and structured risk assessment. 


Grid Level Descriptions: 









No consistent systems assurance, independent review, or risk assessment is 
performed on projects or period support activities. Project team members 
fear reviews. They see them as disruptive and at worst destructive. 







AD/M management recognizes that regular and routine systems assurance, in- 
dependent review, and risk assessment, are an opportunity to help the users 
and project teams achieve their goals. Outside reviews and risk assessments 
begin to be applied to major projects. 





Risk assessment guidance is provided appropriate to projects of all sizes. 
Reviewers are specifically assigned and are trained in review techniques. 
Outside reviews and risk assessments are consistently done for major pro- 
jects. 


The project teams, users, and site management view outside review and risk 
assessment as very helpful. They begin to use review and risk assessment as 
tools to improve their projects and the site guidelines and standards. 


Outside reviews and risk assessments are a natural, expected activity on all 
projects. Results are used to: improve projects; improve knowledge between 


projects; and improve the guidance provided in site standards and 
guidelines. 


5 


Note: For grid position determination see last paragraph page 2: 
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AD/M MATURITY GRID 
07-01-83 


Category: Standards and Guidelines 


The standards and guidelines category relates to the existence, coverage, use 
and quality of the written standards and guidelines for the AD/M function. Un- 
like the previous categories, the maturity level definitions are the same for 
each subcategory in the standards and guidelines category. Each subcategory 
covers a different subject area, and the maturity level of the standards and 
guidelines for that subject area are evaluated. The subject areas are: man- 
agement, resources, processes, standards and guidelines, and tools and 
techniques. These are the same subject areas with the same definitions as the 
categories in the Maturity Grid. 


Consider how well the standards and guidelines cover the needed standard ap- 
proaches, while allowing the use of more effective approaches. Consider how 
quickly and effectively the better ways are encouraged, identified, and incor- 
porated in the guidelines. Consider whether the standards and guidelines are a 
real asset to training new people, and accomplishing the objectives of the site. 
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AD/M MATURITY GRID 
07-01-83 
Category: Standards and Guidelines 


Subcategory: Management - covers the standards and guidelines for the busi- 
nesslike management of the AD/M function. 


Grid Level Descriptions: 





Standards and guidelines, for AD/M management, either don't exist or are lit- 
tle used because they are inflexible and not related to the real needs of the 
organization. They are generally seen as adding work without providing val- 
ue. 


Recognize that standards and guidelines, for AD/M management, must be de- 
veloped to solve real organization needs They must solve real problems and 
must be flexible enough to cover all projects and period support activities, 
and support new approaches and technologies. Development is begun but at 
may be spotty and uncoordinated. 


Standards and guidelines, for AD/M management, exist. They are used effec- 
tively on major projects. Management's review, approval, and actions sup- 
port and reinforce their use. 


Routine review, evaluation, and update of the standards and guidelines for 
AD/M management, keeps them current with the objectives of the organization 
and the most successful practices demonstrated. All projects and period 
support activities are covered. 


Standards and guidelines, for AD/M management, are completely integrated 
with the AD/M processes, tools, and techniques. The management processes 
develop the standards and guidelines; the standards and guidelines guide the 
development or selection of the tools and techniques; and the use of the 
tools and techniques accomplish the processes. 
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Note: For grid position determination see last paragraph page 2: 
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AD/M MATURITY GRID 
07-01-83 
Category: Standards and Guidelines 


Subcategory: Resources - covers the standards and guidelines for the manage- 
ment of AD/M resources with emphasis on the people resource. 


Grid Level Descriptions: 





Standards and guidelines, for AD/M resource management, either don't exist 
or are little used because they are inflexible and not related to the real 


needs of the organization. They are generally seen as adding work without 
providing value. 





1 | 
Recognize that standards and guidelines, for AD/M resource management, must 
be developed to solve real organization needs. They must solve real prob- 
lems and must be flexible enough to cover all projects and period support 
activities, and support new approaches and technologies. Development is be- 
gun but it may be spotty and uncoordinated. 

2 





Standards and guidelines, for AD/M resource management, exist. They are 
used effectively on major projects. Management's review, approval, and ac- 
tions support and reinforce their use. 


AD/M resource management, keeps them current with the objectives of the or- 
ganization and the most successful practices demonstrated. All projects and 


Routine review, evaluation, and update of the standards and guidelines, for 
period support activities are covered. 

| 

| 


eee 
| 
| Standards and guidelines, for AD/M resource management, are completely inte- 
| grated with the AD/M processes, tools, and techniques. The management proc- 
esses develop the standards and guidelines; the standards and guidelines 
| guide the development or selection of the tools and techniques; and the use 
of the tools and techniques accomplish the processes. 
. 
5 | 





Note: For grid position determination see last paragraph page 2: 
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AD/M MATURITY GRID 
07-01-83 


Category: Standards and Guidelines 


Subcategory: Processes - covers the standards and guidelines for the manage- 
ment of the processes by which AD/M work is accomplished. 


Grid Level Descriptions: 


Standards and guidelines, for AD/M processes, either don't exist or are little 
used because they are inflexible and not related to the real needs of the 
organization. They are generally seen as adding work without providing val- 
ue. 


Recognize that standards and guidelines, for AD/M processes, must be devel- 
oped to solve real organization needs. They must solve real problems and 
must be flexible enough to cover all projects and period support activities, 
and support new approaches and technologies. Development is begun but it 
may be spotty and uncoordinated. 


Standards and guidelines, for AD/M processes, exist. They are used effec-. 
tively on major projects. Management's review, approval, and actions sup- 
port and reinforce their use. 


Routine review, evaluation, and update of the standards and guidelines, for 
AD/M processes, keeps them current with the objectives of the organization 
and the most successful practices demonstrated. All projects and period 
support activities are covered. 


Standards and guidelines, for AD/M processes, are completely integrated with 
the AD/M processes, tools, and techniques. The management processes develop 
the standards and guidelines; the standards and guidelines guide the devel- 
opment or selection of the tools and techniques; and the use of the tools 
and techniques accomplish the processes. 


5 


Note: For grid position determination see last paragraph page 2: 


27 


AD/M MATURITY GRID 
07-01-83 
Category: Standards and Guidelines 


Subcategory: Standards and Guidelines - covers the overall architecture and 


plan for the development, installation, use, and update of AD/M standards and 
guidelines. 


Grid Level Descriptions: 





Overall architecture and plans, for AD/M standards and guidelines, either 
don't exist or are little used because they are inflexible and not related to 
the real needs of the organization. They are generally seen as adding work 
without providing value. 


i) 


Recognize that overall architecture and plans, for AD/M standards and 
guidelines, must be developed to solve real organization needs. They must 
solve real problems and must be flexible enough to cover all projects and 
period support activities, and support new approaches and technologies. De- 
velopment is begun but it may be spotty and uncoordinated. 





Overall architecture and plans, for AD/M standards and guidelines, exist. 
They are used effectively on major projects. Management's review, approval, 
and actions support and reinforce their use. 













Routine review, evaluation, and update of the overall architecture and 
plans, for AD/M standards and guidelines, keeps them current with the ob- 
jectives of the organization and the most _ successful practices 
demonstrated. All projects and period support activities are covered. 






Overall architecture and plans, for AD/M standards and guidelines, are com- 
pletely integrated with the AD/M processes, tools, and techniques. The man- 
agement processes develop the standards and guidelines; the standards and 
guidelines guide the development or selection of the tools and techniques; 
and the use of the tools and techniques accomplish the processes. 


Note: For grid position determination see last paragraph page 2: 
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AD/M MATURITY GRID 
07-01-83 


Category: Standards and Guidelines 


Subcategory: Tools and Techniques - covers the standards and guidelines for 
the identification, evaluation, selection, installation, and use of AD/M tools and 
techniques. 


Grid Level Descriptions: 


Standards and guidelines, for AD/M tools and techniques, either don't exist 
or are little used because they are inflexible and not related to the real 
needs of the organization. They are generally seen as adding work without 
providing value. 


Recognize that standards and guidelines, for AD/M tools and techniques, 
must be developed to solve real organization needs. They must solve real 
problems and must be flexible enough to cover all projects and period sup- 
port activities, and support new approaches and technologies. Development 
is begun but it may be spotty and uncoordinated. 


Standards and guidelines, for AD/M tools and techniques, exist. They are 
. used effectively on major projects. Management's review, approval, and ac- 
tions support and reinforce their use. 









Routine review, evaluation, and update of the standards and guidelines, for 
AD/M tools and techniques, keeps them current with the objectives of the 
organization and the most successful practices demonstrated. All projects 
and period support activities are covered. 





Standards and guidelines, for AD/M tools and techniques, are completely in- 
tegrated with the AD/M processes, tools, and techniques. The management 
processes develop the standards and guidelines; the standards and guide- 
lines guide the development or selection of the tools and techniques; and 
the use of the tools and techniques accomplish the processes. 


Note: For grid position determination see last paragraph page 2: 
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AD/M MATURITY GRID 
07-01-83 


Category: Tools and Techniques 


The tools and techniques category relates to the existence, coverage, and quali- 
ty of installed and used tools and techniques for the AD/M function. Like the 
standards and guidelines category, the maturity level definitions are the same 
for each subcategory in the tools and techniques category. Each subcategory 
covers a different subject area, and the maturity level of the tools and tech- 
niques for that subject area are evaluated. The subject areas are: 
management, resources, processes, standards and guidelines, and tools and 
techniques. These are the same subject areas with the same definitions as the 
categories covered in the Maturity Grid. 


Consider how effectively the site evaluates available tools and techniques 
against the needs of the site. Consider how effectively the site identifies and 
analyzes the unfilled needs, to state and solve new requirements. Relative to 
the general existence of useful tools and techniques, for each subject area, 
consider how well those actually installed and used meet the needs of the site. 
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AD/M MATURITY GRID 
07-01-83 
Category: Tools and Techniques 


Subcategory: Management - covers the tools and techniques for the businesslike 
management of the AD/M function. 


Grid Level Descriptions: 









No consistent understanding of where tools and techniques, for AD/M manage- 
ment, are needed or available. If used, they are applied sporadically, with 
unknown results. 









Knowledge and analysis of both the effort and the outcome of fundamental 
AD/M tasks, shows where tools and techniques, for AD/M management, can be 
most effective. Recognize need for consistent effort to identify, use, and 
measure effectiveness of tools and techniques. Measurements may be subjec- 
tive and isolated. 


Growing set of AD/M tools and techniques, for AD/M management, are used on 
major projects. Needed improvements are identified, developed, and in- 
stalled, for future projects. There is a specific search for tools and 
techniques to fill gaps. The information center and development center con- 
cepts begin to focus attention on the integration and use of tools and tech- 
niques. 








The coverage of AD/M tools and techniques, for AD/M management, is expanded 
to all projects and period support. Objective measurement and analysis of 
results provides for easy and natural selection of the best AD/M tools and 
techniques. Information center and development center concepts provide a 
broad complement of useful, integrated tools. 





AD/M tools and techniques, for AD/M management, are integrated completely. 
The processes and standards and guidelines are applied almost automatically 
through use of the tools and techniques. The. feedback on completed projects 
operates to improve the tools and techniques, as it does the processes, 
standards, and guidelines. 


UE EIEEEEEEEEEEEEEREEEEEEEEenee? 


Note: For grid position determination see last paragraph page 2: 
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AD/M MATURITY GRID 
07-01-83 
Category: Tools and Techniques 


Subcategory: Resources - covers the tools and techniques for the management 
of AD/M resources with emphasis on the people resource. 


Grid Level Descriptions: 





No consistent understanding of where tools and techniques, for AD/M resource 
management, are needed or _ available. If used, they are applied 
sporadically, with unknown results. 





Knowledge and analysis of both the effort and the outcome of fundamental 
AD/M tasks, shows where tools and techniques, for AD/M resource management, 
can be most effective. Recognize need for consistent effort to identify, 


| use, and measure effectiveness of tools and techniques. Measurements may be 
| subjective and isolated. 


nt eS a ee 


| 

| Growing set of AD/M tools and techniques, for AD/M resource management, are 

| used on major projects. Needed improvements are identified, developed, and 
installed, for future projects. There is a specific search for tools and 

| techniques to fill gaps. The development center and information center con- 

| cepts begin to focus attention on the integration and use of tools and tech- 

' niques. 










The coverage of AD/M tools and techniques, for AD/M resource management, is 
expanded to all projects and period support. Objective measurement and 
analysis of results provides for easy and natural selection of the best AD/M 
tools and techniques. Development center and information center concepts 
provide a broad complement of useful, integrated tools. 


AD/M tcols and techniques, for AD/M resource management, are integrated 
completely. The processes and standards and guidelines are applied almost 
automatically through use of the tools and techniques. The feedback on com- 
pleted projects operates to improve the tools and techniques, as it does the 
processes, standards, and guidelines. 





Note: For grid position determination see last paragraph page 2: 
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AD/M MATURITY GRID 
07-01-83 


Category: Tools and Techniques 


Subcategory: Processes - covers the tools and techniques for the management of 
the processes by which AD/M work is accomplished. 


Grid Level Descriptions: 


No consistent understanding of where tools and techniques, for AD/M proc- 
esses, are needed or available. If used, they are applied sporadically, 
with unknown results. 


Knowledge and analysis of both the effort and the outcome of fundamental 
AD/M tasks, shows where tools and techniques, for AD/M processes, can be 
most effective. Recognize need for consistent effort to identify, use, and 
measure effectiveness of tools and ESCHEa gues: Measurements may be subjec- 
tive and isolated. 


Growing set of AD/M tools and techniques, for AD/M processes, are used on 
major projects. Needed improvements are identified, developed, and in- 
stalled, for future projects. There is a specific search for tools and 
techniques to fill gaps. The development center and information center con- 
cepts begin to focus attention on the integration and use of tools and tech- 
niques. 


The coverage of AD/M tools and techniques, for AD/M processes, is expanded 
to all projects and period support. Objective measurement and analysis of 
results provides for easy and natural selection of the best AD/M tools and 
techniques. Development center and information center COUSEP ES provide a 
broad complement of useful, integrated tools. 


AD/M tools and techniques, for AD/M processes, are integrated completely. 
The processes and standards and guidelines are applied almost automatically 
through use of the tools and techniques. The feedback on completed projects 
operates to improve the tools and techniques, as it does the processes, 
standards, and guidelines. 


5 
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AD/M MATURITY GRID 
07-01-83 
Category: Tools and Techniques | 
Subcategory: Standards and Guidelines - covers the tools and techniques for 
the development, installation, use, and update of AD/M standards and guide- 


lines. 


Grid Level Descriptions: 













0 
No consistent understanding of where tools and techniques, for AD/M stand- 
ards and guidelines, are needed or available. If used, they are applied 
sporadically, with unknown results. 

1 


Knowledge and analysis of both the effort and the outcome of fundamental 
AD/M tasks, shows where tools and techniques, for AD/M standards and guide- 
lines, can be most effective. Recognize need for consistent effort to 
identify, use, and measure effectiveness of tools and techniques. Measure- 
ments may be subjective and isolated. 





Growing set of AD/M tools and techniques, for AD/M standards . and 
guidelines, are used on major projects. Needed improvements are identified, 
developed, and installed, for future projects. There is a specific search 
for tools and techniques to fill gaps. The development center and informa- 
tion center concepts begin to focus attention on the integration and use of 
tools and techniques. 







3 
The coverage of AD/M tools and techniques, for AD/M standards and 
guidelines, is expanded to all projects and period support. Objective meas- 
urement and analysis of results provides for easy and natural selection of 
the best AD/M tools and techniques. Development center and information cen- 
ter concepts provide a broad complement of useful, integrated tools. 

4 


AD/M tools and techniques, for AD/M standards and guidelines, are integrated 
| completely. The processes and standards and guidelines are applied almost 
automatically through use of the tools and techniques. The feedback on com- 
pleted projects operates to improve the tools and techniques, as it does the 
processes, standards, and guidelines. 
| 
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SHARE NO. SESSION NO. Consultants SESSION TITLE ATTENDANCE 
Technical Support Management Vicki Coronel . USF 
oe ; 
Category: Tools and Techniques PROJECT SESSION CHAIRMAN INST. CODE 


Subcategory: Tools and Techniques - covers the overall coordinating architec- 
ture and tools for the identification, evaluation, selection, installation, and 
coordinated use of AD/M tools and techniques, such as the development center and 
information center concepts. 


Uses. Fidelity & Guaranty, 100 Light Street, Balto., MD 21202, 301-625-5528 
SESSION CHAIRMAN’S COMPANY, ADDRESS, and PHONE NUMBER 


Grid Level Descriptions: 


0 ; ABSTRACT 






As a result of the critical shortage of qualified systems pro- 
grammers many installations have considered hiring contract 
systems programmers or consultants. Rich Schiesser of the Data 
Service Bureau for the City of Los Angeles and Charles Necker of 
the Bendix Corporation both have recent experience using systems 
programmer contractors and consultants. The following are copies 
of the talks given by both individuals describing these experi- 
ences. 


No consistent understanding of where overall coordinating architecture and 
tools, for AD/M tools and techniques, are needed or available. If used, 
they are applied sporadically, with unknown results. 


















Knowledge and analysis of both the effort and the outcome of fundamental 
AD/M tasks, shows where overall coordinating architecture and tools, for 
AD/M tools and techniques, can be most effective. Recognize need for con- 
sistent effort to identify, use, and measure effectiveness of tools and 
techniques. Measurements may be subjective and isolated. 


| Growing set of overall coordinating architecture and tools, for AD/M tools ; 

| and ee ee are used on major projects. Needed improvements are identi- EXPERIENCES WITH SYSTEMS PROGRAMMER CONTRACTORS & CONSULTANTS 
fied, developed, and installed, for future projects. There is a specific 

search for tools and techniques to fill gaps. The development center and Rich Schiesser (DSB) 
information center concepts begin to focus attention on the integration and Data Service Bureau 


use of tools and techniques. City of Los Angeles 
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The coverage of overall coordinating architecture and tools, for AD/M tools 
and techniques, is expanded to all projects and period support. Objective 
measurement and analysis of results provides for easy and natural selection 
of the best AD/M tools and techniques. Development center and information 
center concepts provide a broad complement of useful, integrated tools. 
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niques, are integrated completely. The processes and standards and guide- 
lines are applied almost automatically through use of the tools and 
techniques. The feedback on completed projects operates to improve the 


The overall coordinating architecture and tools, for AD/M tools and tech- 
; tools and techniques, as it does the processes, standards, and guidelines. 
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Note: For grid position determination see last paragraph page 2: 
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